Acoustic echoes reveal room shape.
نویسندگان
چکیده
Imagine that you are blindfolded inside an unknown room. You snap your fingers and listen to the room's response. Can you hear the shape of the room? Some people can do it naturally, but can we design computer algorithms that hear rooms? We show how to compute the shape of a convex polyhedral room from its response to a known sound, recorded by a few microphones. Geometric relationships between the arrival times of echoes enable us to "blindfoldedly" estimate the room geometry. This is achieved by exploiting the properties of Euclidean distance matrices. Furthermore, we show that under mild conditions, first-order echoes provide a unique description of convex polyhedral rooms. Our algorithm starts from the recorded impulse responses and proceeds by learning the correct assignment of echoes to walls. In contrast to earlier methods, the proposed algorithm reconstructs the full 3D geometry of the room from a single sound emission, and with an arbitrary geometry of the microphone array. As long as the microphones can hear the echoes, we can position them as we want. Besides answering a basic question about the inverse problem of room acoustics, our results find applications in areas such as architectural acoustics, indoor localization, virtual reality, and audio forensics.
منابع مشابه
Autonomous Localization and Mapping Using a Single Mobile Device
This paper considers the problem of simultaneous 2-D room shape reconstruction and self-localization without the requirement of any pre-established infrastructure. A mobile device equipped with co-located microphone and loudspeaker as well as internal motion sensors is used to emit acoustic pulses and collect echoes reflected by the walls. Using only first order echoes, room shape recovery and ...
متن کاملAuditory Localization in Rooms: Acoustic Analysis and Behavior
In an ordinary room, reverberation and echoes in the signals reaching a listener’s ears influence auditory localization performance. The energy of the echoes and reverberation depends on the position of the listener in the room as well as on the position of the sound source relative to the listener. In this paper, the effects of echoes and reverberation are quantified through analysis of reverb...
متن کاملHearing the shape of a room.
Seeing the shape of a room is not difficult for most people. Using a combination of stereo vision and parallax as we move around the room, we can resolve the position and angle of walls to determine the size and shape of the room we are in. However, suppose now that you are blind, or in a windowless room with no lights. It is still possible to get a sense of the size of the room by using sound....
متن کاملGrounding Acoustic Echoes in Single View Geometry Estimation
Extracting the 3D geometry plays an important part in scene understanding. Recently, robust visual descriptors are proposed for extracting the indoor scene layout from a passive agent’s perspective, specifically from a single image. Their robustness is mainly due to modelling the physical interaction of the underlying room geometry with the objects and the humans present in the room. In this wo...
متن کاملImplementation of 3D Audio Acoustic Modeling for Real Time Application using Blackfin Processor
Signal processing techniques allow us not only to compensate for the acoustics of a listening environment, but also to add special musical effects such as delay, echo, and reverb, if desired. The most common example is the audio equalizer that allows us to enhance the bass or treble content of an audio signal. What a listener hears in a room depends not only on the acoustics characteristics of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Proceedings of the National Academy of Sciences of the United States of America
دوره 110 30 شماره
صفحات -
تاریخ انتشار 2013